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Assess the investment, approach and impact of NORA 



Collect input from different stakeholder groups as to the 
strengths and weaknesses of NORA 2006 _ 2016 , including general 
strategic approach and tactical execution of the approach 



Recognizing that NORA 1996 _ 2006 and NORA 2006 _ 2016 had different 
origins and responded to different challenges, to compare the 
strengths, weaknesses, and impacts of the 2 decades. 



Scope 



• Big picture including both Intramural and Extramural activities 
•All NORA-funded activities 

•R2p 

• Impact 

• Designed to evaluate leveraging of NORA - funds, resources, 
information, outputs, etc. 

• Designed to answer questions: 

• What did we do in NORA 2006 _ 2016 ? 

• How well did we do it? 

• What was the impact? 



Audiences 



• Funding agencies - 'the people who give us money' 

• Stakeholder groups - Councils; professional, trade and labor 
associations, employers and employees 

• NIOSH intramural and extramural research community 

• Policy making groups - regulatory groups, advisory boards, think 
tanks 

• Other occupational safety and health organizations and agencies 

• Thought leaders 



Products 



• Final printed reports (comprehensive) 



• Electronic information for easy download and quick messaging 



• Bibliometrics of the second decade of NORA 



• Short pieces that may be group or focus area-specific 



• Stories, aural histories, and other evidence of impact 



Timeline 


• April -July 2013 

i / 


• Present plan to internal and external 
stakeholders and request input 


• Aug -Sept 2013 


• Finalize data collection clans 
(including whether OMB clearance) 


• Oct 2013 - Sept2014 


• Data collection 


• Oct 2014 -Dec 2014 


• Data analysis 


• April 30, 2015 


• Final report delivered for review 


• May 2015 -April 2016 


• Prepare final products described 


• April 30, 2016 


• Kick-off third decade, Symposium in 
May or June 



Evaluation Framework 



Domain 


Level 


General Evaluation Questions 


Sector 
Councils 


Process 


What were the activities of the Sector Councils? 


bttectiveness 
Efficiency 


How effective were Sector Councils? 


Impact 


What was the impact of the Sector Councils? 


Partnerships 


Process 


What were the partnership activities involved in advancing NORA 
goals? 


Effectiveness 
Efficiency 


How effective were the partnerships in advancing NORA goals? 


Impact 


What was the impact of using partnerships to advance NORA 
goals? 


Research 


Process 


What were the NIOSH and Other Research Activities related to 
NORA goals? 


Effectiveness 
Efficiency 


To what degree did NIOSH research activities align with NORA 
goals? 


Impact 


What was the impact of the research activities? 



Concurrent evaluation of the efficiency and effectiveness of NORA management/coordination 



Vetting of Evaluation Plan 


Timeline 


• NIOSH LT 


April and July Update 


• NORA Sector Management 


June 


• NORA Partnerships Public Meeting 


June 


• NORA Cross Sector Management 


July 


• NIOSH BSC ^^^^^^^^^^H 


September 



Planning for the 
NORA 2016 Evaluation 



Questions? 




